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(54) Image compensation system for video appliances and methods thereof 

(57) An image compensation system and methods for video appliances to reproduce an optimum image, by judging 
exterior environment and by compensating for an original image by the judged exterior environment. According to the 
system and methods, a color sensor senses color of exterior lighting of an appliance, and provides electrical signals 
corresponding to color components of the sensed color. The signals are converted into a digital value by an analog-to-dig- 
ital converter. A microprocessor judges the type of exterior lighting, by the digitized values, and searches for image 
oompensation data according to the judged exterior lighting. It thereby makes a video processor compensate for an 
original image signal. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an image compen- 
sation system and methods for video appliances, such 
as a color television receiver, etc., which compensates 
automatically for hue, saturation, contrast, brightness, 
and white balance of an image, corresponding with the 
exterior environment of the appliance. 

2. Description of the Prior Art 

Conventional video appliances, especially a televi- 
sion receiver generally adopts a skin color compensation 
circuit and an automatic brightness control circuit, as an 
image signal processor. 

The skin color compensation circuit analyzes a re- 
ceived image signal, and if the signal is judged as a hu- 
man skin color, the circuit provides a prescribed color, 
i.e., a skin color. 

In practice, users often control human skin color 
when adjusting the picture of a television receiver Skin 
color plays a standard part in adjusting the color of a pic- 
ture. 

The skin color compensation circuit, however, can- 
not properly cope with the variety of skin colors, because 
it merely checks without regard to exterior lightings 
whether or not an image signal is a skin color. 

And it works in the same manner on colors analo- 
gous to skin color. 

Therefore, an error in color reproduction may arise, 
and accordingly there will be some limiting factors on nat- 
ural color reproduction. 

The automatic brightness control circuit controls the 
brightness of a picture by sensing exterior brightness. 

The attached FIG. 1 shows a block diagram of a tel- 
evision receiver adopting the automatic brightness con- 
trol circuit. 

The television receiver is, with reference to FIG. 1, 
composed of a tuner 1 for tuning to an aiming station in 
broadcasting signals received by an antenna; an inter- 
mediate-frequency (hereinafter an "IF") signal processor 
2 for processing an IF signal transformed from the tuned 
signal; a detector 3 for detecting an image signal and an 
audio signal from the IF signal processor 2; an audio 
processor 4 for processing the audio signal detected 
from the detector 3; a speaker 5 for making audio sound 
from the processed audio signal; a key selector 6, such 
as key matrix, a remote control or the like, for providing 
a user's key instruction; a microprocessor unit (hereinaf- 
ter an °MPU B ) 7 for allowing the tuner 1 to select an aim- 
ing station according to a user's key instruction, and for 
adjusting brightness of a picture by controlling the follow- 
ing video processor 8, corresponding with exterior bright- 
ness detected by the following brightness detector 10; a 



video processor 8 for controlling the brightness of a pic- 
ture under the control of the MPU 7; a picture tube 9 for 
displaying the image processed by the video processor 
8; and a brightness detector 10 for detecting exterior 
5 brightness, which provides it to the MPU 7. 

In operation, the MPU 7 controls the tuner 1 to select 
an aiming station according to the instruction from the 
key selector 6. The selected station signal is transformed 
into an I F signal at the I F signal processor 2. The I F signal 
is provided to the detector 3. 

The detector 3 detects an image signal and an audio 
signal from the IF signal and provides the image signal 
to the video processor 8 and the audio signal to the audio 
processor 4. 

The audio processor 4 performs amplification of the 
audio signal and various functions, such as stereo repro- 
duction or multivoice processing, and provides the proc- 
essed signal to the speaker 5. 

The video processor 8 performs amplification of the 
image signal and processing a color signal and a lumi- 
nance signal, and provides the processed signals to the 
picture tube 9. 

The brightness detector 10 detects exterior bright- 
ness using a sensor, such as a photoconductive cell 
(CdS), and converts the detected signal into a digital sig- 
nal by an analog-to-digital converter built in the bright- 
ness detector 10. 

The digitized signal is provided to the MPU 7. The 
MPU 7 performs an appropriate operation by using orig- 
inal brightness data CD, exterior brightness data C1 , and 
reference data CO, e.g. CD = CD x C1/C0, and provides 
the resulting value to the video processor 8. 

The video processor 8 compensates for the bright- 
ness data CD in accordance with the exterior brightness 
data CI, and thereby the brightness of the picture tube 9 
can be adjusted. 

In such an automatic brightness control circuit, how- 
ever, it is difficult to perform sufficient natural color repro- 
duction because the circuit processes brightness (or 
contrast) only. 

In fact, it is necessary to control all the image repro- 
duction factors, i.e. hue, saturation, contrast, brightness, 
and white balance, for complete natural color reproduc- 
tion. Without collective control of these factors, it is im- 
possible to accomplish natural color reproduction, and it 
is difficult to properly represent an image bearing natural 
colors. 

SUMMARY OF THE INVENTION 

The present invention, which is directed to avoiding 
such a problem, reproduces an optimum image and per- 
forms complete natural color reproduction, by judging 
the exterior environment by sensing exterior lighting, and 
compensatinng for an original image based on the 
judged exterior environment. 

According to one feature of this invention, there is 
provided an image compensation system for video ap- 
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pliances, comprising: 

means for sensing a color of exterior lighting and 
for providing electrical signals corresponding to color 
components of said sensed color; 

an ana log -to-digital converter for converting the 5 
output signals of said color sensing means into a digital 
value; 

means for processing the output signal of said an- 
alog-to-digital converter under the instruction of a pre- 
pared program, having (i) a memory for memorizing im- io 
age compensation data corresponding to the color of ex- 
terior lighting, (ii) means for searching for corresponding 
data among said image compensation data, reading the 
output of said analog-to-digital converter, and (iii) means 
for outputting the searched data; and is 

means for compensating for an original image sig- 
nal utilizing the output signal of said processing means. 

According to another feature of this invention, there 
are provided image compensation methods for video ap- 
pliances, comprising the steps of; 20 

sensing a color of exterior lighting and providing 
electrical signals corresponding to color components of 
said sensed color; 

digitizing said electrical signals corresponding to 
said color components; 2s 

judging exterior environment from said digitized 
signal; 

searching for image compensation data corre- 
sponding to said exterior environment; and 

compensating for an original image signal utilizing 30 
said image compensation data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages 35 
of the present invention will become better understood 
with regard to the following description, appended 
claims, and accompanying drawings where: 

FIG. 1 is a block diagram of a television receiver 40 
adopting a conventional automatic brightness con- 
trol circuit; 

FIG. 2 is a block diagram of a television receiver 
adopting an image compensation system of the 45 
present invention; 

FIG. 3 is a detailed block diagram of a color sen- 
sor/processor depicted in FIG. 2; 

so 

FIG. 4 is a flowchart explaining the general operation 
of the present invention; 

FIG. 5 is a table showing the output value of color 
components from a color sensor, according to an 55 
exterior environment; 

FIG. 6 is a view showing conditions of an exterior 



environment for storing data; 

FIGs. 7 A and 7B are tables showing image compen- 
sation data according to the summation of color 
components; and 

FIGs. 8A and 8B are flowcharts explaining the oper- 
ation of another embodiment of the present inven- 
tion. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

The operation of the present invention will be dis- 
cussed with regard to FIG. 2 through FIG. 7. 

Referring to FIG. 2, the system according to the 
present invention, an image compensation system for 
video appliances, is composed of; a tuner 100 fortuning 
to an aiming station in broadcasting signals received by 
an antenna; an IF signal processor 200 lor processing 
an I F s ignal transformed from the tuned signal; a detector 
300 for detecting an image signal and an audio signal 
from the IF signal processor 200; an audio processor 400 
for processing the audio signal detected from the detec- 
tor 300; a speaker 500 for making audio sound from the 
processed audio signal; a key selector 600, such as a 
key matrix, a remote control or the like, for providing a 
user's key instruction; an MPU 700 for allowing the tuner 
100 to select an aiming station in accordance with a us- 
er's key instruction, and for adjusting brightness of a pic- 
ture by controlling the following video processor 800, cor- 
responding with exterior lightings and colors detected by 
the following color sensor/processor 1 000; a video proc- 
essor 800 for compensating for an original image signal 
under the control of the MPU 700; a picture tube 900 for 
displaying the image signal processed by the video proc- 
essor 800; and a color sensor/processor 1000 for sens- 
ing and processing the exterior lightings and colors. 

The color sensor/processor 1000 includes, referring 
to FIG. 3, a color sensor 11 A for decomposing incident 
light into the three primary colors, i.e., red, green, and 
blue; an amplifier 11 B for amplifying the color signals 
from the color sensor 11 A; a low-pass filter 1 1 C for elim- 
inating noise from the amplified color signal; an ana- 
log-to-digital converter 11 D for converting the analog 
color signal from the low-pass filter 1 1 C into a digital sig- 
nal. 

The analog-lo-digital converter is represented as an 
'ADC in the drawings for briefness. It may be equipped 
in the MPU 700 accordingly as the function of a micro- 
computer or microprocessor has recently been expand- 
ed. 

The operation of such a constructed system, an im- 
age compensation system for video appliances, will be 
described with reference to FIGs. 2 and 3 and a flowchart 
in FIG. 4. 

The MPU 700 controls the tuner 100 to select an 
aiming station in broadcasting signals according to the 
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instruction from the key selector 600. The selected sta- 
tion signal is transformed into an 1 F signal at the IF signal 
processor 200, and is provided to the detector 300. 

The detector 300 detects an image signal and an 
audio signal from the IF signal, and provides the audio 
signal to the audio processor 400 and the image signal 
to the video processor 800. 

The audio processor 400 performs amplification of 
the audio signal and various functions, such as stereo 
reproduction or multivoice processing, and provides the 
processed signal to the speaker 500. 

The video processor 800 performs amplification of 
the image signal and processing a color signal and a lu- 
minance signal, and provides the processed signals to 
the picture tube 900. 

The color sensor/processor 1 000 senses the color 
of exterior lightings, such as sunlight or any other artificial 
light, and amplifies the color signal and rejects noise. 
Thereafter the color sensor/processor 1 000 provides the 
processed signal to the analog-to-digital converter 1 1 D 
as color data. 

The MPU 700 finds the current exterior lighting en- 
vironment using the digitized color data. It thereafter pro- 
vides a properly compensated image data (hue, satura- 
tion, contrast, brightness, and white balance) to the video 
processor 800. 

Specifically, with reference to FIG. 3, the color sen- 
sor 11 A decomposes the exterior lighting, such as sun- 
light or any other artificial light, into red (R), green (G), 
and blue (B). Because the output level of the color sensor 
is weak, it is provided to the low-pass filter 1 1 C after be- 
ing amplified by the amplifier 11 B. 

The low-pass filter 1 1 C produces a purified color sig- 
nal by eliminating noise from the signal outputted from 
the amplifier 11 B (in the case of light bearing a tow-fre- 
quency flicker, there is noise similar to a sinusoidal 
wave), 

The color signal passing through the low-pass filter 
1 1 C is converted intoa digital signal at the analog-to-dig- 
ital converter 11 D, and is provided as color data to the 
MPU 700. 

The color data being provided, the MPU 700 analyz- 
es current exterior lightings, and provides proper color 
compensation data to the video processor 800 using the 
result of analysis. 

In general, colors of R, G, and Bare called the three 
primary colors of light. By changing the mix ratio of the 
colors, almost all of the colors can be represented on a 
picture tube. For instance, in the case of white color, the 
projection degree of R, G, and B is T; respectively; in 
the case of grey color, the projection degree is '0,5', re- 
spectively. If the three colors are not projected, black 
color is represented. 

In contrast, a color sensor decomposes incident light 
into R, G and B, and provides electrical signals propor- 
tional to the amount of the color components. 

FIG. 5 shows an exemplary relative data of the out- 
put value of R, G, and B where exterior environment is 



a fluorescent lamp, an incandescent lamp, sunlight, or 
no light (darkroom). 

The above data are served as reference data for 
judgement of what the current exterior environment is, 
5 which are stored in a memory in a microprocessor. 

The general operation of the present invention will 
be described with reference to a flowchart in FIG. 4. 

The MPU 700 reads a quantized color data (digitized 
output of the color sensor) directing the current exterior 
io lightings, and judges thereby the exterior enviroment 
mode. If it finds thereafter an original image mode to be 
outputted by retrieving the color data entering the video 
processor 800, and compares the original image mode 
with the exterior environment mode, 
is Here, although image compensation can be per- 
formed for all of the quantized color data from the color 
sensor, a processing sequence may become too com- 
plicated. In addition, because human eyesight is, as a 
matter of fact, not able to distinguish delicate color dif- 
20 ferences, only the artificial light used for common homes 
and natural light (including weather conditions and 
times) were taken into consideration. 

That is, as shown in FIG. 6, taking a fine day, a 
cloudy day, a rainy day, a morning, a noon, an evening, 
2S a night, a fluorescent lamp, an incandescent lamp : and 
no light (a darkroom) as factors for judgement to exterior 
environment, 36 kinds of exterior environment modes 
can be set. Since the correlation between- night and 
weather is low and if the case that similar outputs are 
30 provided is considered, the number of cases may be re- 
duced to an appropriate extent. 

The exterior environment mode may be determined 
not only when the color data from the color sensor 11 A 
is completely in accord with the prescribed reference 
35 data but also when the color data lies within the pre- 
scribed range. 

In such cases, the MPU 700 compares the original 
image mode to be outputted with the exterior environ- 
ment mode now being inputted. 
40 if the two modes are the same, the MPU 700 outputs 
the untreated original image data to the video processor 
800, and maintains the original image mode. 

If the two modes are different, the MPU 700 com- 
pensates for the original image data by the determined 
45 exterior environment mode, and provides the compen- 
sated image mode to the video processor 800. Accord- 
ingly, the compensated image bearing the optimum hue, 
saturation, brightness : contrast, and white balance, 
which are in accordance with the exterior environment, 
so is displayed on the picture tube 900. 

Taking a set whose brightness step, saturation step, 
and contrast step respectively range from 0 to 62 and 
hue step ranges from -31 to +31 as an actual example, 
the set provides an image of hue=0, saturation=31 , 
55 brightness=31, contrast=62, and white balance=9000K 
in the case of no light (a darkroom); the set provides an 
image of hue=-5, saturation=26, brightness=60, con- 
trast=62, and write balance=10000K in the case of an 
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incandescent lamp. 

Such data is based upon actual measurement. Al- 
though it may have a slight difference on the effect of any 
other environmental factor rather than illuminance or 
lighting, it deserves acceptance when considering hu- 
man eyesight. 

Since lighting of an incandescent lamp is brighter 
than lighting of no light, i.e., a darkroom, brightness of a 
picture must be strengthened. Since a red color compo- 
nent of an incandescent lamp is larger, a red color signal 
must be relatively reduced by controlling hue and satu- 
ration of a picture. Thus, there appears different data in 
each mode. 

The representative feature of the embodiment so far 
discussed is to find the exterior environment by reading 
quantized color (R, G, and B) signals from a color sensor, 
and thereby to compensate for an original image, 

Another embodiment compensating for received im- 
age data will be disclosed with reference to FIGs. 7Aand 
7B and FIGs. 8A and 8B. 

This embodiment relates to image compensation 
methods which compensate for an image data by com- 
puting the summation of the electrical value of the quan- 
tized or digitized color signal (R, G, and B), or by judging 
the magnitude of R and B and the correlation between 
them. 

The summation (S) of the value of the quantized 
color signals R, G, and B (in the case of 6-bit, 0-64) cor- 
relates with illuminance of the exterior lighting. From the 
value S, an image compensation data is, as a first step, 
determined, and thereby the original image data is com- 
pensated for. Thereafter, as a second step, white bal- 
ance is compensated for by the value B-R or R-B as 
shown in FIG. 7B. 

Specifically, FIG. 7 A shows image compensation 
data of a set whose contrast step ranges from 30 to 1 00, 
brightness step ranges from 40 to 60, saturation step 
ranges from 40 to 55, and sharpness step ranges from 
30 to 60. As first image compensation data, the data are 
determined according to the summation of R, G, and B, 
i.e., the illuminance of exterior lighting. 

FIG. 7B shows, as second image compensation da- 
ta, that if the summation of the quantized R, G, and B 
lies within a regular range, the data are determined by 
the difference and correlation between R and B. 

The second image compensation data additionally 
compensates for white balance of a picture and accord- 
ingly accomplishes complete color reproduction accord- 
ing to the exterior lightings. 

The system according to this embodiment reads the 
analog -to-digital quantized value from the color sensor, 
and computes R-B or B-R. Thereafter, it compares the 
value of R-B or B-R with G of exterior lighting, and there- 
by searches for image compensation data for brightness, 
saturation, contrast, sharpness, white balance in a soft- 
ware table. The found image compensation data com- 
pensates for the original image data. Here, the reason 
for computing both R-B and B-R is that the software 



method is not capable of dealing with a negative compu- 
tation. 

FIGs. 8A and 8B show flowcharts explaining the op- 
eration of this embodiment, based upon the tables indi- 
5 cated in FIGs. 7A and 7B. The flowcharts indicate how 
compensation data, according to the values of R, G, and 
B from the color sensor, are produced. 

From the foregoing, the present invention measures 
image data, such as hue, contrast, brightness, satura- 
te tion, white balance, changing the conditions of exterior 
lightings. And it establishes a data base by the measured 
data. The data base is stored in a memory in a micro- 
processor. 

The present invention determines current exterior 
15 environment using the measured data from the data 
base, and automatically compensates for hue, satura- 
tion, contrast, brightness, and white balance of a picture. 

Accordingly, an image is reproduced with complete 
fidelity, and therefore a high-quality picture can be pro- 
20 duced. 



Claims 



25 1. An image compensation system for video appli- 
ances, comprising: 

means for sensing a color of exterior lighting 
to provide electrical signals corresponding to color 
components of said sensed color; 

30 an analog-to-digital converter for converting 

said electrical signals from said color sensing means 
into a digital value; 

means for processing the output signal of said 
analog-to-digital converter under the instruction of a 

35 prepared program, including (i) a memory for mem- 
orizing image compensation data corresponding to 
the color of exterior lighting, (11 ) means for reading 
the output of said analog-to-digital converter to 
search for corresponding data among said image 

40 compensation data, and (iii) means for outputting 
the searched data; and 

means for compensating for an original image 
signal utilizing the output signal of said processing 
means. 

45 

2. The system according to claim 1 , wherein said ana- 
log-to-digital converter is built in said memory of said 
processing means. 

50 3. An image compensation system for video appli- 
ances, comprising: 

means for sensing a color of exterior lighting 
to provide electrical signals corresponding to color 
components of said sensed color; 
55 an amplifierfor amplifying said signal from said 

color sensing means; 

a noise rejection filter for eliminating noise 
from the amplified signal from said amplifier; 
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an analog-to-digital converter for converting 
the output signal of said noise rejection filter into a 
digital value; 

means for processing the output signal of said 
analog-to-digital converter under the instruction of a s 
prepared program, including (i) a memory for mem- 
orizing an image compensation data corresponding 
to the color of exterior lighting, (ii) means for reading 
the output of said analog-to-digital converter to 
search for a corresponding data among said image 10 
compensation data, and (iii) means for outputting 
the searched data; 

means for compensating for an original image 
signal utilizing the output signal of said processing 
means. is 

4. An image compensation system for a color televi- 
sion receiver, comprising; 

means for providing key instructions according 
to a user's key selection; 20 

means for tuning to an aiming station for 
received broadcasting signals; 

means for transforming the output signal of 
said tuning means into an intermediate-frequency 
signal, and for processing said intermediate- fre- 2s 
quency signal; 

means for detecting an image signal and an 
audio signal from said intermediate-frequency sig- 
nal; 

means for processing said detected audio sig- 30 
nal to produce audio sound; 

means for sensing a color of exterior lighting 
and for providing electrical signals corresponding to 
color components of said sensed color; 

an analog-to-digital converter for converting 35 
the output signals of said color sensing means into 
a digital value; 

means for processing the output signal of said 
analog-to-digital converter under the instruction of a 
prepared program, including (i) a memory for mem- 40 
orizing image compensation data corresponding to 
the color of exterior lighting, (ii) means for reading 
the output of said analog-to-digital converter to 
search for corresponding data among said image 
compensation data, and (iii) means for outputting 45 
the searched data; 

means for compensating for an original image 
signal utilizing the output signal of said processing 
means; and 

means for displaying said compensated image so 
signal from said compensating means. 

5. An image compensation method for video appli- 
ances, comprising the steps of: 

sensing a color of exterior lighting and provid- ss 
ing electrical signals corresponding to color compo- 
nents of said sensed color; 

digitizing said electrical signals corresponding 



to said color components; 

judging an exterior environment from said dig- 
itized signal; 

searching for an image compensation data 
corresponding to said exterior environment; and 

compensating for an original image signal uti- 
lizing said image compensation data. 

6. An image compensation method for video appli- 
ances, comprising the steps of: 

sensing a color of exterior lighting and provid- 
ing electrical signals corresponding to color compo- 
nents of said sensed color; 

digitizing said electrical signals corresponding 
to said color components; 

determining an image compensation data, 
having the substeps of (i) summing said digitized 
color components, (ii) judging exterior environment 
corresponding to said summed value, and (iii) pro- 
ducing said image compensation data correspond- 
ing to said judged exterior environment; and 

compensating for an original image signal uti- 
lizing said image compensation data. 

7. An image compensation method for video appli- 
ances, comprising the steps of: 

sensing a color of exterior lighting and provid- 
ing electrical signals corresponding to color compo- 
nents of said sensed color; 

digitizing said electrical signals corresponding 
to said color components; 

determining image compensation data, having 
the substeps of (i) summing said digitized color com- 
ponents, (ii) judging exterior environment corre- 
sponding to said summed value, (iii) producing first 
image compensation data corresponding to said 
judged exterior environment, (iv) judging the quan- 
tity of said summed value and a correlation between 
said color components, and (v) producing second 
image compensation data corresponding to said 
judged quantity and said correlation; and 

compensating for an original image signal uti- 
lizing said first and second image compensation 
data. 
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